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Note  on  Statistical  Texture  Discrimination 
C.  li.  Chen 
Rong~:!wang  Wu 

1.  ^Summary 

For  a  given  textured  image,  experimental  results  on  texture  feature  extraction, 
dimensionality  reduction,  and  iterative  Bayes  classification  are  reported.  The 
classification  performance  is  superior  to  other  texture  discrimination  methods  that 
have  been  etamiued  on  the  same  data.  While  the  method  presented  is  recommended  as 
an  effective  statistical  texture  discrimination  approach,  the  large  amount  of 
computation  required,  especially  in  feature  extraction,  can  be  undesirable  ir.  some 
applications.  Detailed  computer  program  listing  is  given  in  the  Appendix., 

2,  Texture  Feature  Extraction 
The  image  examined  is  a  6b  x  bb  textured  image  described  in  an  earlier  report  (!]. 

Because  the  image  size  is  small,  the  cooccurrence  matrix  is  computed  for  distance  }. 

The  number  of  gray  levels  is  1 6.  The  l6  x  l6  co-occurrence  matrix  P  is  generated 

[2]  for  angles  0=0°,  b5°,  90°,  and  135°.  For  each  P  matrix,  we  compute  the 

following  four  measurements. 

(i)  Angular  Second  {foment 

N-l  N-l  „ 

q-  l  i  <V 

1-1  j=l  J 

where  N  is  the  number  of  gray  levels  and  P.,  is  an  element  of  matrix  P. 
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(il)  Inertia  or  Contrast 
N-l  N-l 
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(iii)  Correlation 
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Despite  the  directional  effect,  ve  take  the  average  and  the  maximum  difference 
of  the  functional  values,  as  they  vary  with  $.  A  set  of  8  texture  features  is 
formed  as 

x  =  [f^,  Al^,  ?2,  Afg,  f^,  Af^,  f^,  Af^]1 
where  f  =  the  value  averaged  over  the  four  directions  0  =  0°,  U 5°,  90°  and  135° 


Af,  =  f .  -  f,  , 

i  i  max  i  min 


3.  Feature  Space  Transformation 

We  now  consider  the  problems  of  finding  the  optimum  discriminat  vectors  and 
transforming  the  original  feature  space  to  the  maximum  discriminant  feature  space. 
After  the  texture  features  are  generated,  we  choose  a  set  of  25  x  25  learning 
feature  sets  for  each  class  and  follow  the  method  developed  by  Foley  and  Saramon  [3] 


to  calculate  the  first  three  largest  discriminant  values  (y^,  Yg,  &  v^)  and  their 


corresponding  vectors  (d^,  d^,  &  d^).  By  using  these  three  vectors  we  can  transfer: 
x  from  original  8-dimensional  feature  space  into  a  3-dimensional  maximum 
discriminant  feature  space  by 
y  =  Ax 

T 

where  A  -  [d^,  d^,  d^]  is  a  3  x  8  matrix 
x  is  an  8  x  1  feature  vector 
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y  is  a  3  x  1  feature  vector 
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Texture  classification 

The  use  of  k-NN  decision  rule  suggested  by  Stark  and  O'Toole  [^provided 
poor  result  while  requiring  an  enormous  computer  time  for  large  number  of  learning 
samples.  An  iterative  Bayes  decision  rule  as  proposed  in  the  following  is  much  more 
effective.  A  multivariate  Gaussian  assumption  is  made  for  each  class  with  mean 
vectors  M.  and  covariance  matrices  ,  i  =  1,2.  Also  let  P(w.)  be  the  a  priori 

x  i  i 

probability.  The  Bayes  classification  rule  is  therefore 

\  (y  -  m1)t  if  (y  -  Mx)  -  |  (y  -  m2)T  if  (y  -  ti>) 

\l\  P(w1)  wi 

+  Jin  — v —  zrj — '—r-  •>  ye 

2  jlsj  "  “2 

for  pixel  y  in  the  transformed  space.  Initially  we  assume  P(io^)  =  P(w2)  =  0.5. 

After  the  decision  is  made  for  the  pixel,  and  the  pixels  of  its  5x5  neighborhood, 
the  percentage  number  of  pixels  within  the  5x5  neighborhood  classified  as  um  is 
used  as  updated  value  of  P(uk).  The  procedure  is  performed  iteratively  to  update 
P(wi)  in  each  iteration. 

5.  Computer  Results 

Figure  1  is  the  ideal  segmentation  of  the  textured  image  [1].  Fi  //ere  2  is  the 
result  of  using  the  Bayes  decision  rule  with  equal  a  priori  probability  (without  any 
iteration).  Figure  3  is  the  result  of  one  iteration  while  Fig.  H  is  cue  result  of 
t  iterations.  The  convergence  is  extremely  fast  as  it  cakes  only  iterations  to 
provide  a  low  error  rate  of  1.5625$.  In  the  previous  work  [1],  the  use  of  maximum 
a  posteriori  estimation  has  an  error  rate  of  3.96$.  More  recently  we  have  reported 
(5]  an  error  rate  of  2.05$  by  using  Fisher's  linear  discriminant  and  the  texture 
features  of  angular  second  moment,  oonstrast,  and  entropy.  Thus  the  present  method 
has  the  lowest  error  rate.  It  does  require,  however,  more  than  twice  of  the 


? 
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computation  time  as  compared  with  the  Fisher's  linear  discriminant  method. 
Computation  of  texture  features  is  most  time  consuming.  In  the  future  when  the 
co-occurrence  matrix  computer  is  developed,  the  computation  time  can  be  greatly 
reduced. 
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Computer  Program  Listing 


Note:  Feature  extraction  is  performed  by  File  [50,50] 

Feature  space  transformation  is  performed  by  File  QIC  [50,50] 

File  ODVl  [50,50]  and  File  CCMP  [50,50] 

Classification  is  performed  by  File  CL2  [50,50]  File  PRIK  [50,50] 


Appendix 


C 

C  Hlifc:  FEACCSO.  b03l 

(• 

.C.  •  :•: 

£  FEATURE  EXTRACTION  •  '  : 

0 

D  I  Mb  NS  1  ON  A(S,  £4  ) ,  T  (£4 ) ,  IT(64) 

COMMON  NE,  NQ,  NG1,  LL,  IUA(64,  64),  PU6,  16),  11,  Jl,  Li,  QM(8> ,  DFC16)  , 
WR1TE(6» Ill > 

111  FORMAT ( 1 X, " WHICH  FEATUR  THAT  YOU  WANT  TO  CHANGE  ?"/ 

MX,  "FIRST  FEATURE,  NF’=1"/ IX,  "SECOND  FEATURE,  NF~2"/ 

21 X,  'THREE  FEATURE, NF=3"/1X,  "FOURTH  FEAT URb ,  NE!‘4"/ 

SIX,  "NF=’,"/  '0 ' ) 

HEAD  (6,  1 1 2 )  NF 
M2  FORMAT  (14) 

WRITE. (6,  M3) 

M3  FORMAT (IX,  "CHOOSE  A  NEW  FEATURE"/ 

11X,"  ANGUI  .AR  SECOND  HOMAN  IFNI,  NC==  1 '  / 

FIX,  "INERT  1A,  NO?' /IX.  'AOTOCOKKbl  A I  ION  NC=3'  / 

31 X,  "ENTROPY,  NC*1'/1X,  "JOINT  PROBARll  IT  Y,  NC‘=t '  / 

41 X,  "MIXED,  NC"6"/1X,  "NC=  ''"/"O") 

READ (A,  112 )NC  » j  | 

WRITE (6,  114 >NF, NC  !  j 

).  1  4  FORMAT  <bX.  '  NF  -  ■  ‘ ,  I  b,  i'X,  NO"  '  ,  )  V  >  j 

NUl=WP#2  | 

NQ.-Ntil-l  | 

c  ! 

c  CHANGE'  ORIGINAL  206  GRAY  LEVEL  TO  16  GRAY  LEVELS  ? 

C  | 

DEFINE  E  1  Lb  3(64,  64,  U,  INDEX  )  f 

INDEX"!  !  | 

DO  100  1=1,64  j  i 

READ (3" INDEX) IT  !  : 

DO  100  JM.64 
DO  100  KT,  16 
II*(K-1>*15 
IH“K*i5 

IF ( IT(  J).  LT.  IL.  OR.  I  T ( J ) .  Gh.  IH)GU  TO  100 
IDA( I, J)=K 

1 00  CONI  1 NUE  ; 

DU  101  1  A- 1,64 

WRITE  (6,  10;  )  (  IDA  (  I  A,  IB),  IBM,  16) 

102  FORMAT  MX,  1612) 

101  CONTINUE 
END  FILE  3 

C 

C  El!  E  ;  t.INE  1  ,0  1 12  ARE  Si  OKED  ORIGINAL  FEATURES, 

C  EACH  PIXEL  HAS’  8  FEATURE. 

C  LINE  521  TO  712  ARE  STORED  COMPRESSED  FEATURES, 

C  EACH  PIXEL  HAS  MAX.  3  DIMENSIONS 

C  I  INF  /7l  10  ‘84  AND  LINS  SCO  !U  S64  AR!  SORED  IkO  £4*64 

C  IMAGES 

C  j 


.  <t  «rHjk>£  >?&■£&£ 


DPFTNE  FILE  2<$64,  128,  U,  INDEX); 

i:=2i  63.  .  •  „  s.v  V 

I1-=I 

DO  2  J=2, 63 
J1=J 

DO  33  K~ 1 , 3 
QM  ( K )  =0. 

DO  33  Kl=l,  3.6 
DF(K3  )  “0. 

DO  4  L=l,  4 
Ll-L 

LL=(NF-i)  *4+1.1 
DO  32KA=1,  16 
DO  32  KB=li 16 
P  ( KA,  KU)=0, 

CALL  GUM 
CALL  JOIN  (NO 
CONTINUE 
CALL  MAXDF 
QM(NQ)>=QM<NQ)/4. 

DO  6  N  -NQ,  NQ1 
A(N.  J )  -QM  ( N ) 

CONTINUE 

FORMAT (//60X,  'I (MS,  IX,  M//S(F15.  5,5X)) 

DO  7  NS=NQ, NQ1 
INDEX=(I~i)*8+NS 
DO  P  N'l  =  l ,  64 
'I  ( N'l  )-*A(NS,  N'l  ) 

WKI’tk  (2^ INDEX)'! 

CONTINUE 
WRITE (6, 10>I 
FORMAT ( 1 OX, 15) 

CONI INUb 
CAI  L  DP  LI 
CALL  PIXI'r 
END 

tt************************************** ************ 
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*************************************************** 
SUBROUTINE  GUM 

COMMON  NF,NQ,NQ1,LL,  IDA(64,  64  ) ,  P(  16,  16),  1 1 ,  J 1 ,  Li ,  QM  ( 3 ) ,  DF  ( 16) 
OO. 

IS1'!  1-7 
DO  1  1=1,3 
IS— IH+ 1 
JS=Jl-2 
DO  2  J-1,3 
JS=JS+1 

0010(11,  12,  13,  14 )Ll 

1  1  -IS 

JT~ JS+1 

GO  TO  15 

IT=IS-1 

JT=JS+1 

GC  It  1!: 

I  1  =  13-1 
_‘T  *JS 
GO  TO  15 
IT=IS-1 
JT=JS-1 


■aaar^i aa 


2 

5 
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C 

G 

C 

C 

0 

C 

C 

C 

C: 


iOt 


11 

102 


21 


103 


ID=IABS( 1T-I1 ) 

JD:=  I ABS  C  ■  J'!  -Jl> 

IF  (in.  or.  1.  OR.  JD.  GT.  1  )G0  TO  2 

M-libAC;IS,  ^S)  . 

m~&t naforef .  rh)  .  ^  - 

P(M,  N>-4P(M,  N>  +  1. 

F(N.  M>wPCN.  M>  +  1. 

C-C+2. 

CONTIIMI  IE 
CONTINUE 
DO  6  K=l» 10 
DO  6  L=1 ,  10 
P(K<  L >~P(K,  L)/C 
RETURN 

END  , 

101  :  ANGUI.AR  SECOND  MOMENT 

102  .  INERT  I A 

103  :  CORRELATION 

104  ;  ENTROPY 

105  :  JOIN  PROP ABILITY 

106:  <(I-J>#»3)*L0G(P<I. J)+l.  ) 

SUBROUTINE  JOIN  (NO 

COMMON  NE,NQ,  NQ1,IL,  1DA<64,  6'  > ,  P(  16,  16),  1 1 ,  J 1 ,  L.1  #  QM ( S ) ,  DE  ( 1 6 ) 

G0TQC101,  102, 103,  104,  105,  106),  WC 

E1”0. 

DO  11  I«l, 16 
DO  11  J=3 , 16 
IE  (P(  I,  J).  EQ  0.  )G0  TO  11 
El  =E1+P(I,  J)*P(1,  J) 

continue: 

QM ( NQ  >  =  QM ( NO  >  +E 1 
DE(LL)nEl 
GO  TO  100 
E2=-0. 

DO  2;  1**1,  16 
11=1-1 

DO  21  J«l. 16 

1F(P(  I,  J).  EQ.  0  >G0  TO  21 
JJ=J-1 

DIJ-ELUAT ( 1I-JJ) 

D2”DIJ*DIJ 
E2=K2+D2*P(I,  J> 

CONTINUE 

QM ( NO ) =QM ( NQ ) -E  2 
DE  (LI. >=*-2 
GO  TU  ‘00 
E2=0. 

UX«0. 

UY=0. 

QXS=0. 

QYS-O. 

DO  31  1  =  1,  16 
CI=FI.0AT(I-1> 

DO  31  J=l,  16 

IF(P(  I,  J)  EQ.  0.  )G0  TO  31 

CJ=EL OAT(J-l) 

UX=UX+CH-P(I,  J> 

L'Y  =UY+CJ*E'(  I,  J) 


A,;  VP* 


i 


i 


31  ... . CONTINUE  .  ,  .  .  . 

DO  32.  1=1,  16  .  ■  .  •  '  ’  7\  '• 

ci.=EiibAT(i-i)  ; 

.  no  32  J=i,  i& 

IF(P(I,  J).  EQ.  0.  )G0  TO  32 
CJ=  FLOAT  <  J-l ) 

,F,C1=CI#CI*P(I,.J.) 

FC2=CJ«CJftP(I,  J) 

QXS-QXS+FC5 

QY§=qVs^FC2  -  "  " 

32  CONTINUE 
QXS=QXS-UX#UX 
QYS=QYS-UY#UY 

IF  (QXS.  bQ.  0.  .  OK*.  QY3.  FA  0.  >00  Tu  10 

UXY:=UX#UY 

QX=SQRT (QXS) 

QY=SQRT(QYS> 

QXY=QX»QY 
DO  33  1=1, 16 
Cl “FLOAT ( 1-1 ) 

DO  33  J=l, 16 
CO=FLQAT< J-l > 

I F  ( P ( I ,  ■  J ) .  HO.  0.  )GC  Tt  32 
F  3=F  3+  ( C I  fcCJttP  ( I ,  *J  >  ) 

33  CONTINUE 

F3=  <  F3-UXY ) /QXY 
OH ( NQ ) =QM  <  NQ ) +F3 
GO  TO  17 
10  5-3  *1.  0 

QM(NQ) 'QM (NQ  >  +  l.  0 
WRI7FK6,  12)11,  Jl,  LI 

12  FORMAT (IX,  13,  2X,  '01=',  13,  2X,  'Ll=',  13,  2X, 

1  ''VARIANCE  =  0V/> 

17  »K(U.)--F3 

00  TO  100 
5  04  F4-0. 

L'0  41  1  =  1,  16 
DO  45  0=1,  16 
IF  (P<  I,  -J).  EQ.  0.  >G0  TO  41 
F4=F4+P ( I,  J) #AL0G10 (P( I,  J) ) 

41  rON.INIIt 

CM  <  NQ  >  —  QM  ( NQ  >  +1  4 
DF ( LL ) =P  4 
GO  TO  100 
1 0!5  F5=0. 

DO  01  1  =  1,  16 
11=1-1 

DO  Ki  0=1, 16 
IF  (P<  I<  J>.  tu.  0.  >GU  10  D1 
00=0-1 

FIJ=FLQAT(II#OJ> 

F5=FU+FIJ*P<I, J) 

M  CONTINUE 

QH  ( NO  >  =QM  ( NO  >  -F  ‘j 
1JF  (LL)=Ft 
GO  TO  100 
106  F6=0. 

DO  61  1=1, 16 
1 1— I— t 

DO  61  0=1,  lo 
I  p  ( P  ( 1 ,  0  > .  to.  0.  )  DU  T  O  6 1 
00=0-1 

V I J=FLO AT  <11 -00 ) 


A4 


:  -VVyjW'^V*  •■*  f  s^-fuvfv,^.--^ 


61  ;. 

100 


c 

c 

c 

c 

c 


10 
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FIJ=ABS(VI.J)  ::-,  .  :  .  ;>;‘  \- 

W=FIJ#FIJ 
V=VV#FI J 

„  F6=F.6.+V* AL 0G10(P(1,J)+1.  ) 

"COW-ftffeJE  £  c 

QI^NWQMCNQy+Ffe  ' 

DF(LI.)=F6  v 

RETURN 

END 

SUBROUTINE  MAXDF 

C.oRMQN  NF,  NQ,  NQ1,  LLi  I  DA  (64,  64  ),  P(  16,  16),  II,  Jl,  LI,  QlftS), 
REAL  D ( 6 ) ,  DC ( 4 ) 

II-(NF-1  )*4 
IM=NK»2 
M— <J 

DO  2  Jrrl,  4 
DC ( J ) =DF ( 1 3  + J ) 

DO  7  K= 1 , 3 
KS-=K+1 

DO  7  KK-KS, 4 
H=  M+ 1 

D ( M ) =ABS ( DC ( K ) -DC ( KK ) ) 

DM-DU  ) 

DO  3  L»2, 6 

IF  (DM.  GT.  D  ( L  )  )  GO  TO  3 
DM"D(L) 

COivlT  INUF 
QM( IM)=DM 
RETURN 
END 


"  a".  '  ;,V*7  J3>T.S 

,2/  7  *"  {*>:  i/i'rj 
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CHOOSE  LEARNING  SAMRI  ES 


HEAL  A  ( 200,  2b  ) ,  F  ( 64  ) .  H  ( 2i  ) 

DEFINE.  FILE  2(064,  128,  U,  INDEX) 

WRITF:<6,  10) 

FORMAT ( 1 X,  'READ  NF,  I XI,  IYI,  IXF,  IYFV'O') 
READ <6,  1 1 ) NF , 1X1,  IY3 ,  IXF,  IYF 
FORMAT  ( 'jib) 

IS=( 1Y1-1 )tt3+l 
IT»IYF*& 
iD=rr-is+i 
INDEX- IS 
I  X=I  XF  -  I  X I  •*■  1 
) Xl-I Xl-1 
DO  1  I-n,  ID 
READ  (2 -'INDEX  )F 
DO  1  J=l, IX 
A  <  I ,  J )  =F  ( I X 1  +  J ) 

END  FILE  7 

DEF I NE  FILE  1 ( 4 08 , SO, U> I NDh X ) 
)NDEX=(NF-1) *200+1 


DO  2  1,200 

DO  3  L-1,25 
R(L)“A(K,l.) 

WR1  iF  <1'  INDEX) R 
CONI 1NUE 
CALL  BELL 
CALL  EXIT 
END 


$ 
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FILE:  0DV1LS0,  SOI 

FIND  A  OPTIMAL  SET  OF.  DISCRIMINANT  VECTORS. 

REAL.  A (2b ) .  U  (2,  8 ) ,  DT  ( 8 ) ,  S (8,  S ) 

REAL  SZ(8,  .8  ).,.D  (.8,.25>,i  WW(2,  S,  8>,U(S,,8) 

REAL  Ui 8).  WK  8, O) ,  WSl%8 ) , f(S ) ,0DC8 ) #;6UV ($,;«:);  -  .  ■•! 
RF.ALTWiT  8*  3 ),WZ(8t  8  W GL<  6 ) ,  SN1  (6MSC(8>  ?  - 

DEFINE  'FILE  1*408,  SO,  II,  INDEX) 

WRITE  (.6,  10) 

FORMAT  (IX,  ''SIZE  OF  (.EARNING  SAURIES  (N*N>'/'0'> 
READ.(6».I.1.)N 

FORMATS  13 >  .  ' 


FIND  MEAN  111  U?  AND  DIFERENCE  DT 


DO  1  1-1,2  | 

I1=(I~1)<>200  I 

DO  2  0=1, N  ! 

J1>=(J-1>*S  i 

DO  3  K=1 , 8 

INUEX-Il+JJ+K  I 

READ (1" INDEX) A 

DO  3  Lal.N  -  ; 

U(I»K)=U(I,K)+A(L>  | 

CONTINUE  S 

CONTINUE  ' 

DO  4  Misl,  8  ; 

U(I,M)«U(I,M)/FLOAT(N#N>  ? 

CONTINUE  I 

DO  12  ID=1,  2 

WRITE. (0,  33)IU,  (IJ(  ID,  K) ,  K=3 , 8)  \ 

[<  FORMAT  (  (X.  yU(  12,  IX,  SMb.  *5/)  • 

I/.  CONTINUE 

DO  5  1*1,8 

DT  ( I ) =U ( 1 < I  >  -U  ( 2, I ) 

WRITE ( li,  34)  DT 

4  FORMAT  (//IX,  'DT  =' .  OF  1*5.  b)  , 


FIND  W1THIN-CLASS  SCATER  MATRIX  A  AND  ITS  INVERSE:  MAT IX 

JJO  6  I  •=  1 , 2 

I1«(I-1)*200 
DO  7  J--1.N 
Jl=(J-l)#S 
1NDEX=I1+J1+1 
DO  8  K=l,  8 
READ ( 1 ^ INDEX ) A 
DO  8  L-  1,2b 

D(K, L)=A(L)  | 

8  CONTINUE  ! 

<5 

if 


v 

7 


15 

6 


22 

21 


25 

24 

22 

C 

C 

C 

l- 

C 


&M*$Q04>  NMa 
V-  :D0  ?  K’l=l,3  • 


•rv" 


i^+jg&fhJi  ■' 


lip 


116 


117 

ns 

119 


199 

0 

c 

c 

c 

V 


DO  9  Ll=l,8 
1)01*D(K1»  N1)-U(I.  K1  ) 

DD2=D (I.1,N1)-U (-1,  LI)-- 

WW(I. Kl,  L1)=WW(I.  Kl.  L1>+DD1*DD2 

C0N7 I HUE 

CONTINUE 

DO  15  K2»1.8 

DO  15  L.2=l,8 

WW,(  I  t  K2»  1,2.)  =WW  (  I ,  K2#  L2 )  /FLOATS  W#N  > 

CONTINUE  •  •'$■  •.' 

CONTINUE  ’  •  '“  '•  , 

DO'  110  KS=lrS  *’• 

DO  110  KT=1 »  8 

W1(KS, KT)=WW( 1.  KS* KT ) 

W2(KS,KT)=WW<2,  KS.-KT.) 

CONTINUE  " 

DO'  1.16  I  -l,  3 
DO  il6  J-.-1.8 
W(I. J)-W1(1.  J)+W2(I, J) 

WRIT  E(5,  117)W1 
WRITE(b« 11S)W2 
FORMAT ( //40X,  -'Wl  VS  ( FI 5.  4  > ) 

FORMAT (//40Xi  "W2"/8(F15.  4)  > 

WRITE (5.  <  19>W 

FORMAT (Z/40X,  "W"/8(Flb.  4)) 

ND-8 

CALL  INVEKS(W, Ml, ND> 

WRITE <6* 199) 

FORMAT  <  IX,  "  INVERSE  W  0K!"/"0"> 

FINE  "ALPHA  1" 

DO  21  1*1,  8 
DO  21  J*l,  S 
SUM=0. 

DO  22  K  -1, 8 

SIJM*SUM+WI(I,  K)#U1(K,  J> 

WS(  I, J)~SUM 

CONTINUE 

AL-O. 

DO  2 A  J-1.8 
3UM=0. 

DO '2b  K=ii  8 
SUM=SUM+WS ( J,  K  > *DT ( K ) 

T(U)=8UM 
CONTINUE 
DO  23  1*1, 8 
AL=AL+DT <  1  >  #7  ( I ) 

CONTINUE 
AL«1.  /SORT  (  At  ) 

FINE  D1 

DO  26  1  =  1,  8 
SUM=0. 

DO  27  J=1 , 8 
8UM=SUM+W1 ( I ,  J  > *DT ( J ) 

0D(I)=8UM#AL 

SI 


A7  1 


:e  ./■'  ;  >:.!#  "oxscRiH-VAUji-:,  ri  "  *  r/jV' .  '  T  K 

c 

.  NE~1  1 

CALL  KNV(W,  OD,  DT,  Nt)  I 

C  j 

C  KINK  SI  3.  FOR  £(1,1)  &  £-1(1,1)  1 

C  j 

C  **#M#M&*%#*m*m*#**#***##M***m*m.#.mmm##**,.  _.,_J  \ 

■  -  DO  29  J=1,  S  -  ••  •.  ■  .  ■•  ' %*< .  --.  >$*  '.W:W?'  : 

•;  '  "•  sum>o.  •  J  \vi:.^J  f 

DO  30  K=1 , 8  ‘  ■  ■ ;  ) 

30  SUM=SUM+W I  (  J,  K  >  #0U  ( K )  j 

T ( J  > «SUM  ; 

29  CONTINUE 

£11-0. 

DO  23  1=1 / Q 

23  Sli=Sli+0)i(I)#T(I) 

S(l, 1  )-Sll 
81(1,  1)  =  1.  /SU 

C.  i 

C  SET  COLOUM  Cl/At.  0  0  0  . 3  AND  STORE  "Dl"  TO  "ODV" 

C  ! 

CI.(1)-1./AL  ! 

DO  41  1=2,7 
41  CL  ( I )  «0. 

DO  148  J=l,  3 
143  £)DV(  J,  1  )  =  0n(  J) 

C 

G  DO  LOOP  FINE  D,  R  &  S 

C 

C  *>##############################*#####################. 

DO  40  NDssl,  4  ! 

NF=ND+1 

IF  (ND.  KQ.  1  )G0  TO  44 

p  ! 

C  FINE  MAT RIG  S  AND  ITS  INVERSE  MATRIX 

C 

DO  61  K 1  =  3 , 3 
SUM=0. 

DO  62  K2=t, 8 

62  SUM=SUM+WI(K1,  K2)ftODV(K2, ND) 

T(K1)=SUM 

61  CONTINUE 

DO  63  K3:=l,  ND 
SUM=0. 

DO  64  K4=l, 8 

64  SUM=SUM+0DV(K4.  K3>*T(K4) 

Y(K3)=SUM 

63  CONTINUE, 

DO  6b  Kb”  1 ,  ND 
S(Kb, ND)=Y(Kb) 

S(ND, K5)=Y(K5) 

6b  CONTINUE 

CALL  INVERS(£, SI, ND) 


f  INE  AND  $TORE  TO  "ODV" 


'  -  v"  i  ‘  ’T>’ 

3UM=0. 

DO  43  J=1,NB 

SUM=  eSUM+3  I  LIj  J )  *CL  (J.)  .. 

8N1 (I)«SUM 
CONTINUE 
DO  45  K=1 , 3 
SUM— 0. 

DO  46  L=3 ,  NB 
SUM!sSUM*CiOV.(KiL)#SNHU 

JDSGXK)  =DT  (K  >  -SUM,  •  ■  .  -  ;•  -  ^ 

CONTINUE  ■  -  *  .  ' 

DO  47  1  =  1, 3 
SUM=0. 

DO  48  J=3 i 3 
SUM«SUM+WIU.-J)*USt;M> 

OD(:I.)*SUM 

CONTINUE 

SUH”0. 

DO  49  1=1 <8 
SUM=3UM+0D<  I  >#0D<]  ) 

ALN-l.  /SORT (HUM) 

DO  50  1=1,  8 
ODm™QD<I>#ALN 
ODV  < I ,  ME ) =QU  < I ) 

CONI INUE 


FINE  "RN" 

tt4HMtt#**»**tt*4H>**tf#****tt*ft*Httttt#*tt**#*tH***#*4HMt* 
CAI  L  RNV(W,  0D»  D'l  ,  NF  ) 

CONTINUE 
INDEX=401 
DO  55  1*1,8 
DO  56  U-l,  5 
A ( J  >  =QDV ( I »  J ) 

CON  I  I NUE 

WRITE  (5,  156)  <A<K>,  K«l,  5> 

FORMAT  (5(5Xi  F15.  6) ) 

WRITEd'lNDEXIA 

CONTINUE 

call  be:ll 

CALL  EXIT 
END 

SUDROUT I NE  RNV ( W, OD,  UT ,  NK ) 

REAL  0D(3) j  DT(8) i W(3, S), T(S) 

SUM-0, 

DO  1  1  =  1,8 
SUM=SUIT+OD<l>*Df<I> 

DNI*1=SUH#SUM 
DO  1=1,3 
SUM=0. 

DO  3  J=i, 8 
SUM=SiJM+W  ( 1 , .  j  )  *0D  ( J ) 

T  <  1 )  =  SUM 
SUM=0. 

DO  4  K=  1  *  8 
SUM»SUM+OU(K)*T(K) 


a6gwa3ate3ga«i»!>»il!gS!»«w«^^ 

AlO  ! 

RN=DNM/SUM  "‘  : -  ;  V  '3 

WRITE  (.5 >  1 40  );NE>  Rhi  •  ’  ■•'*  j 

140  FORMAT (10X.  'RNK,  12,  IX.  •')='',  K15.  6)  ; 

RETURN  !  ' 

END  .... 

SUBROUTINE  INVERSE ST-S.Ii'ND)  .  V  ' 

REAL  3(S,  8)  i,SI(SiiS)  -'  ,  ’:  ;‘l 

COMMON  SD<S»S),eMl(S)»CM2(g),Y(8)fCN,Nt, -Hi  •  '' 

SKI,  1)=1.  /S(l,  1) 

DO  2  N.~2>  ND  : 

Nl-N-l 

DO  1  11=1, N1 
•j  Y(II)=S(N.  II) 

CALL  STY (SI) 

CALL  YTTS(SI) 

CAI  L  COST  ( S ) 

CALL  LETT UR (SI)  j 

DO  3  K=*l» N1  1 

DO  3  L= 1 ,  N 1 

3  SI  (K,  L)=SD(K,  D/CN 

no  A  I 1 ,  IM 1 

SKI,  N>=0.  -(OHIO  )/CN) 

SKIM,  I)=0.  - ( CM2 ( 1 ) /CN ) 

4  CONTINUE  ; 

SI  <N,  N)«l.  /CN 

2  CONTINUE  ! 

CALL  BELL 
RE  I  URN 
END 

SUBROUTINE  STY (SI) 

REAL  SI (8,  8) 

COMMON  S)J(8,  8),  CM1  (8),  CM2(8) ,  Y(8) *  CN,  Nl,  N 

DO  1  1  =  1,  Nl 

SUM:-0. 

no  2  J=  1,  Nl 

2  SUM=SUM+S  I  <  I ,  J  >  ■#  Y  ( J  > 

1  CM! ( 1 )=SUM 
RETURN 
END 

SUDROUl INK  Y ITS (SI) 

REAL  S1(B, 8) 

COMMON  SD (8,  8),  CM1 (8) ,  CM2 (8 ) , Y (8) ,  CN, Nl, N 
DO  1  1=1, Nl 

SUM=0.  ! 

no  ?  j--i.ni 

SUM=SUM+Y< J)*SI (J,  3 ) 

2  CON  I  INUir 

1  CM2 ( I ) =SUM 

RETURN 
END 

SUBROUI INK  COST ( S  > 

REAL  S(8, S> 

COMMON  SD (8,  8),  CM1(8).  CM2(8),  Y(8).  CN,  Nl,  N 
CN=S(N,  N) 

DO  1  1=1, Nl 

1  CN=CN-Y ( I ) ftCMl ( I ) 

Kr’i URN 
END 

SUDRCUI INK  LEE  I  UR (SI) 

REAL  SI (£, 8) 

COMMON  SD(8, 8) , CM1 (8) ,  CM2 (8 > ,  Y (£) ,  CN,  Nl.N 

.  .  _ _  _  _  .  .  ,  _  _  . 


O  C:  a  Q  O-  O 


All 


'  VtilDOA©  §# lA'N  1  ?•  •  ■ > 

;  do  i  J-=i.  ni 

4  SD  ( I .  J )  =CM?  ( 1  >  *CM2 ( J )  +SI  <  I. »  J ) #CN 

a  . a  **  .  • .  -  ^  - 


■m. 


S$f, 

*  rt 


„  v*>V; 

n  t  » n  ^  **£*  | 


FILE:  COHPCtO,  501 

TRANSFORM  THE  ORIGINAL  EIGHT-DIMENSION " FHAtURE  SPACE  A 
TO  N  (N  LESS-FQUAi:  3)  DIMENSONAL  FEATURE  SPACE. 


a##########*##*####**##########  w*#####*?##*:-########*-#*### 
REAL  A  (8*  5),  X(8,  64),  Y(3*  64),  F(64>,  E(2U> 

WRITE (6,  147) 

FORMAT  (IX*  'THE  DIMENSION  OF  COMPRESSION  -  ?(MAX.  *3)  VO") 
READ  <6,  1!39>NP 
FORMAT ( 12 > 

DEFINE  FILF  J  (408.  f.O,  U,  INDEX) 

INDEX-401 
DC  11  1  =  1,8 
,READ(1"  INDEX  >F. 

DO  11  J=1,NP 
A  ( I ,  J )  =  E  ( J ) 

CONI  INI  IF 
END  FILE  1 

DEFINE  FILE  2(864, 128, U* INDEX) 

DO  101  1=1*64 
F(I)=*0. 

INDEX =021 
DO  102  J=l, 192 
WRITE (2" INDEX )F 
DO  1  1=2,63 
INDEX*"  ( 1-1  >#8+1 
DO  2  J=i , 8 
READ (2" INDEX )F 
DO  3  K«l. 64 
X(J,  K ) “F ( K ) 

CONTINUE 
DO  111  11=1,  NP 
DO  111  JJ=1, 64 
SUM=0. 

DO  112  KK=1 , 8 

SUM=SUM-A ( KK. 1 1 ) *X (KK,  JJ ) 

Y( II, J J ) “SUM 
CONTINUE 

INDHX=( 1-1 ) #3+521 
DO  5  12  =  1,  NP 
DO  6  JJ=1 1  64 
F ( JJ)=Y ( 1 1 1 JJ) 

writf:(2"iniiex)f 

-CONTINUE. 

CONTINUE 
CALL  BELL 
CALL  EX II 
END 


KILK:  CL2L50, 50D 


REAI .  F  <  64  > .  Y  <  3.  64  > ,  X  <  2,  3,  225 ) ,  U  < 2.  3 ) ,  COV  (2,3,3).  COV I  ( 2,  3,  3 ) 


-N5T-- .•:.W  T.V’,r-  •—  .  .  *’•  -.  . 


DFl ERMINE  THE  ORIGINAL  POINTS  OP  LEARNING  SAMPLES 
.,  THE  COMPRESSION  DIMENSIONS  AND  THE,  BOUNDARY  OK  IMAGE. 


DEFINE  KILE  2  ('86  A,  128, U,  INDEX) 

WRITE (6. 10) 

FORMAT  (IX,  ' READ  1XX ,  IY1,  1X2,  I Y2,  ND  '/'O'  ) 
READ (6,  ll)lX(l),  IY(1),  IX(2),  IY(2),ND 
FORMAT (5 IS) 

I XI l"49o 
lVll-552 
I XF 1-756 
I YF 1-292 
1X12=504. 

I Y 12=544 
IXF2-748 
IYF2=300 


f 

I 


C  CHOOSE  LEARNING  SAMPLES 

C 

DO  1  1=1,2 

1 1  =  < IY ( I ) -1 ) #3+520 

I X 1  =  I X ( I >-l 

DO  2  J=l, 15 

KK=(J-l)ttl5 

J1=(U-1>#3 

DO  3  K= 1 ,  ND 

IN»FX*I1+J3+K 

READ(2-''  INDEX )F 

DO  3  L-T,  15 

KN-KK+L 

3  X( I,  K,  KN)=F( IX1+L) 

2  CONTINUE 

1  CONT ) NUE 

C  tf#######*############################################### 

c 

C  CAI.CULATE  MEAN  ,  COVARIANCE  MATRIX  AND  ITS  INVERS  MAT IX, 

C 

Q  ft############*##############*#########*############*'#### 

11U  21  I--1.2 
DO  20  M“1,ND 
20  U(I,h)=-0. 

DO  22  J=l, ND 
DO  22  K=l, 225 

22  LKI,  J)=U(I,  J)  +  X(l,  J,  K> 


'tC) 

21 


m 


DO  29  M=1,ND 
U(I.  M)=U(I,  M>/225. 

CONTINUE 
DO  28  1  =  1,2 
DO  24  J=l,22!5 
DO  2b  K=1»ND 
T(K>«X(t.K,  J)-U<], K) 

DO  26  L-1..ND 

.  110,  26  IT=1,  ND  . . 

26  ,  ;  .  COV  M,  L,  N')=COV(I,.L,  M>-rTCI.)*T(M)  _  .  % 

24  CONTINUE  f 

DO  27  N=1,ND  -j 

DO  27  N1=1,ND 

CN=C0V<I,N,  Nl>/225 

CQV(  I,  N,  N1  >=C:N 

SC0V<N,.I'I1>=CN 

27  CONTINUE 

CALL  INVERS(SCOV,  SCOVI,NU> 

DO  28  N=1 , ND 
DO  23  N 1 = 1 , ND 

23  COVIXI,  N,  N1)=SCQVI(N,  Nl) 

28  CONTINUE 

C 

C  FIND  THE  DETERMINE  OF  COVARIANCE  MATRIX.  ! 

C 

1F<NR  EQ.  3)  GO  TO  43  (! 

L10  41  1  =  1,2  1 

41  cv(i>=cov(i,  t,  n#covn,2,2>~cov<i,  i,2>#cova,2,  i> 

GO  TO  49 

45  DO  44  11*1,2 

DO  4b  KK= 1 , 2 
DO  45  J J= 1 i 3 
IK*(KK~1)*3+  U 
DO  4b  J=l, 3 

45  F:(J,  IK)=C0V(1I,  J,  JJ) 

C1=0. 

02=0. 

DO  46  KK=1,3  | 

K2=KK+1  i 

K3=KK+2  i 

C 1 =C 1 + ( b ( 1 ,  KK>*K(2,  K2))*F(3, K3)  ! 

C2=C2+ ( t  <  3, KK >  #h  ( , ,  K2 ) ) *b  < 1 , K3 > 

46  CONTINUE 

CV(  1 1 )=ABS(C1-C2 ) 

44  CONTINUE 

49  VCV=CV(1>/CV<2> 

AL  V=AI  00<VCV> 

c 

C  CLASSIFICATION,  DISPLAY  AND  STORAGE 

C 

OftLi  VIJINDO ( 1 .  ,  64.  ,  1.  ,  64.  ) 

CALL  SWINDCKbOO,  256,  300,  2b 6) 

DO  51  1=2,63 
INDEX=(I-J  >#3!+521 
DO  52  J=1 ,  ND 
READ (2' INDEX )F 
DC  50  K= 1 . 6 4 

50  Y(.J,  K)=F(K) 

52  CONTINUE 


JDO  ’  h3  "Hrtj?&-.»  v 

"-y>  -  A*,;  <*’'%,  »«*  .'  •**,-'  v  .  <fc»>V  /x  *  -  '*-na-L“  A.  V* 

,  v..  DO  ;54  'N=i7:2;'  —  ;  •  :  J  -  • 

bo  .54  4=1., ND 

54  XM(N,  J)=Y(J.M)-U(N.  J) 

DO  55  L=l.  2 

DO  55  J=1,ND  ...  _ _ 

SUM=0. 

DC  56  K-1,ND 

56  SUM«SiUM+COVI(L,  J,  K>*XM(L.  K> 
TM(L, J)=SUM 

55  CONTINUE 

DO.  57  L,=  i,  2 
,,  -  SUM=0, 

«,  DO  <58  J=l,  ND  -!  • 

58  ‘  SUM-SUM+^M  < L ,  J  >  *TM  <  L,  J ) 

.  xvx(i_)=suii 

57  CONTINUE. 


<#- 


r  aM2=XVX(1)-XVX(2) 

HX!5(  XMl2+ALV)/2.  „  * 

IF(HX.  Gf.  0.  >00  TO  60 
DA  ( M  D=  1 . 

GO  TO  53 
60  DA(M)=0. 

53  CONTINUE 

YY=64. -FLOAT(I) 

DO  59  J=l  ,  64 

Ir(DAvu).  fcW.  0.  )G0  TO  59 

XX»FLOAT<J> 

CAi  L  POINT  A  (  XXi  YY  > 

59  _  CONTINUE 

INDEX* I +720 
WRITE (2" INDEX ) DA 
53  CONTINUE  ' 

CAI  L  WINDOdXIl,  1YI1.  I  XU.  IYF1) 
CALI.  BELL 


w»  ^  vs 


Al4 


$ 

j 


4 


’’4 

I 


*W\ 

C  ITERAT ION 

C 

READ (6, 499) IE 
499  ECRI1  AT  (12) 

CALL  NEWPAG 
DO  500  MI  =  1, 16 
WRITE (6>  501 ) HI 

501  FORMAT ( iOX,  'ITERATION',  15) 

lNUE>:=/22 
DO  201  1=1, 5 
READ (2' INDEX )F 
DO  202  J=1 , 64 
202  CA  ( I , J ) =F ( J ) 

201  CONTINUE 

DO  25.1  1=4,61 
INDEX- (1-1) #3+521 
DO  252  J  =1,ND 
READ (2' INDEX )F 
DO  250  K=1 , 64 
250  Y  <  J,  K )  =E  ( K ) 

252  i  ON  i  1NI.JL 

DC  253  M=4,  61 
P1<=0. 

Mi=M-3 

DO  353  MM=1,  b 


m 


854 

355 

356 


2154 


2  56 


235 


258 


257 


260 

258 


259 


359 


360 

251 


361 


DO  353  NN=1,S 
NX-Mi+NN 
P1=P1+CA(MM,  NX) 

P-l*Pi-CA(3.  M> 

P.2=24.  -PI 

IF  (PI.  HQ.  24.  )G0  TO  354 
3  F  ( P 1  HQ  0.  >00  TO  355 
AI.P=AL00(Pi/P2> 

GO  TO  256 
Al  P=100. 

GO  TO  356 
Al  P=-100. 

DO  254  N~ 1 1  2 

DO  21:4  J=l,  ND 

XM(Ni  J)=Y(  J,  M)-U(N.  J) 

DO  255  L:=  1  <  2 
DO  255  J”ii  ND 
SUM=0. 

HO  256  K:"l*  NH 

SUH® SiJh+OOO I  ( L i  J,  K)*Xh(L,  K> 

TM(L. J)»SUM 

CONTINUE 

DO  257  L«1.2 

SUH=0. 

DC  258  J~  1 »  N)  i 
SUM«SUM+XH(L.  J)**TM(L»  J> 
XVX(L)-SUH 
CONTINUE 

XM12=XVX(1 >-XVX(2> 

HX=’  <  XM12+ALV  >  /?.. 

Ai.P=AI.P*4. 

IMHX.  GT.  ALP) GO  TO  260 
DA(MD-1. 

GO  TO  253 
DA  <  M  >  *0. 

CONTINUE: 

YY-64.  -FI  OAT  ( I  ) 

DO  259  J®1,64 

1F(DA( J).  HQ.  0.  )G0  10  259 

XX=KLOAT(J> 

CAI  L  POINT  A  (XX,  YY) 

CONTINUE 
INDHX =1+800 
WN]'IT (2y INDEX) DA 
DO  359  J-1,  4 
J1=J+1 

DO  359  K= 1 , 64 
CA( J, K)=CA( Jl, K> 

INDEX- ( 1+2 )+720 
KHALI (2  ' INDEX  >E 
DO  360  K= 1 , 64 
0A(5i K)=F(K) 

CONTINUE 
DO  261  t=4, 53 
INDEX® I +7 20 
HE  AD ( 2 1  NDE  X  )  E  1 
INDEX- =1+300 
RHAD(2' INDEX )E 
DO  263  MH=4,  61 
H1(MH)=F(MH> 

INDEX® I +720 
WKliE(2  INDEX.' El 
L  I  IN  f  1  NUE 


|CAkls.~W;I-NDO  #X^'I‘Y.I2v 

CAUL  B.ELL  ■;-::  ■  :$>  •  •' ■  ■  -;  -  .  -:  r-  ' 

RE'AD<6,  262) IR  .  :V  -  .  .  r  '  - 

K0RMAT(I2) 

CALL  NEWRAG 
CQNT INUb" 

CALL  .BELL 

GALL  EXIT  -  -  .  "  .*  * 

end  ..  ,  ■  '  :*  . 

SUBROUTINE  WINUOdXI.  IYI,  IXE,  IYE ) 

CALL  MQVABSdXl,  IYI) 

CALL  BRWABS d  X I ,  I YE ) 

CALL  DRWABSdXK,  1YF) 

CALL  DRWABSdXK,  IYI) 

CALL  DRWABSdXl.  1Y1) 

CAI.L  BELL 

RETURN 

END 

SUBROUTINE  INVKK8<$« SX.  ND) 

REAL  S(3»3>iSX'(3<3? 

COMMON  SB  (0,  3 )  ,'CMi  (3  > »  CM2 < 3 ) «  Y <3 ) «  ON.  Nl<  N 
SKI,  1>  =  1.  /S(l,  1) 

DO  2  N-2, ND 
N11:N-1 

DO  1  II»1»  I'll 
Y(II)=S(N,  II) 

CALL  STY (SI) 

CAI  L  YTTS (SI ) 

CALL  COST ( S ) 

CALL  LEE  "I  UR  (SI) 

BO  3  K«1.N1 
DO  3  L”l, Nl 
SI (K, L)=SB(K,  L)/CN 
DO  4  I-1.N1 

SKI,  N ) ~0  -(CMKD/CN) 

SUN,  I)  0.  -(CM2d)/CN) 

CONTINUE. 

SI  (N,  N)*l.  /CN 
CONTINUE 
CAI  L  BELI¬ 
KE  T  URN 
RIND 

SUBROUTINE  STY (SI) 

REAL  SI (3,  3) 

COMMON  SD(3,  3),  CM1 (3 ) , CM2 (3) , Y(3) , CN, Nl,  N 

DO  1  I>~1 ,  Nl 

SUM~0 

DO  2  J-l.  Nl 
SUM=SUM.*SI(I,  J>#Y(J> 

CM1  ( I  >=StJM 

RETURN 

END 

SUBROUTINE  YTTS(SI) 

REAL  SI  (3,  C- ) 

COMMON  SD(3, 3), CHI (3) , CM2(3> , Y(3>,  CN.  Ni,  N 

DO  1  I:*1»N1 

SUM=0. 

DO  2  J-- 1 ,  N 1 
SUM-SUM+ Y  ( J )  1  ( J.  1  ) 

CONTINUE 
CM2 ( I ) =SUM 
RETURN 


SUBROUTINE  CCiST(S) 

REAL  S(3,  3) 

COMMON.  SR  (3,  3 L.CM  1  (f3 ) »  CM?. ( 3 ) ,  Y ( 3 h  CN,  Nl,  N. 
CtvifeS(M,  N)  •  ,  ;; 

mpi.i  i=i  ,  N1 

Ci'l=CN~Y  ( I )  -&CM1  ( I ) 

RETURN 

END 

SUBROUTINE  LEFTUP(SI) 

REAL  SI-($i3) 

COMMON  SEi.(3»  3>i.CMl  (3)i  CM2(3)»,Y(3),  CNrNi«  N 

do  i 

DO  1  J=1,N1 

SD(  I.  J)=CM1  ( I ) i-CM? ( J ) +S1 ( I ,  J ) #CN 

RETURN 

END 


HIDE:  PR IF  LOO,  '503 

PRINT  OUT  THE  RESULT 

REAL  E  (  <>4  ) 

INTEGER  IA(*4) 

*  DEFINE  FILE  2 <864, 128,  U,  INDEX) 
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10 

WRITE (6,  10) 

E ORMAT (IX.  'FILE  V? 1-734  ,  NF 

%:■ 

READ <6. 11 )NK 

5. 

1 

n 

FORMAT (12) 

s 

rw 

IF(NF.  EQ.  2) GO  TO  22 

w 

INDEX® 724 

£ 

& 

,* 

GO  TO  33 

U; 

. 

2:? 

INDEX -304 

1 

3:.-: 

DO  1  1=4,  61 

Js 

1 

READ (2' INDEX )E 

1 

DO  2  J=4, 61 

i 

2 

1A(  J)'®INT(F ( J) ) 

l 

WRITE (5.  44) (1A(I1>, 11=4, 61) 

if 

j£ 

44 

FORMAT  ( 10X,  bSl  1  > 

1 

CONT 1NUE 

§- 

CALL  DELI- 

CAl  L  EXIT 
END 
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